M 170 726 



CB 00« 838 



AUTHOR 
PUB 

IDfS PRICE 
DSSCPr PTOPS 



T tllMTIFT IPS 
ABSTRACT 



Hain# R ay E. 

ffftdts □£ Of ^aiiiia*^ icca 1 ^ida on L*^arninq frcw Pto>^*^ 

Na^y Pifsannil fi^s^aatdh and D# v^lepni^n t c^nt^^r^ S'ln 
ni^qop califi 

VPCOS Plus Post%g4. 
Adultsi •Cori^^n* R^adingi *Cl&gcanis? ^Instructional 
aa^ €rt4 1b\ Of 94 nl^atl P0£ti^con3 aty f 1 udat ion } 
♦Reading B^s^ar ch\ "^P «!call (Psy ehol cgical ) ; 
*Re*6ntioni See^ndacy Education; Sti:ay Skills 
*Proo% learning 



Th4 obj^cti?«a off this study Wisre tc identify and 
s^aluat© .^tra^^gie^ for organising prcf^ aontint that appear 
afproF^taw fot t^Al-lif^ ttalnirig applicatiatis* An analysis of pros^* 
pagsaqes in a ^yolodl high stfho<3l g^i^icc^ t^ki Id^nUfii^a tht€4 basics 
tip^B af gtaohlo ^tpras^n^.a^ i^rt 51 ast€eiatlv# <AR) ^ eampitativ^ (CS), 
and di^^eted (D^)» CnQ^ appropriate s^t^ of fcehavioral objectives 
M^t^ np^Qiii^6 and grapiiic f^^iats aiiflayiiig ^Ach type of 
f^lattonihlp d^^ignidt tbr^^ irii icucti cm A tirtatments w4r^ 

priipaE^d! t% set (T) f xt'-ai juite^. (TA) in which tha text waa 
suppl^man^.fd wl^h OB an^ CR dlagtaasj atd t^xt^uiia^ rlinsfl (TO) In 
which the gfiDhie inforBatlon «aB siifly und^tlin^d* Sroups of 56 
Mavy Moruiti^ *5qually dlvifl^a into high and low science achl^veoi^nt 
l^r^lSp patticlnatid in ene c& the thtt# tr^atnentii folloii^^d by fr^^. 
reaall and ei yltlpl^-'choic^ pirforrcanc^i t^sts* Ihe findings w^r^ 
#qyiveeal with r^sp^ct to th^ a^v^antagt^ of supplettcnt ing ptOBm taxt 
with organisational aids' although XK ttmtmnt waf eleatly superior 
1b the frte recall of DB mat^rlali^ TO was suptrior In t^rnis ©f 
Bitalt ipl^*ehciee ^e^^ p^rfotifiamo^ on CI fflat#riala, contrary to 
^3£pectat ionSf no ifignlficant Interact Ic n betn^en tr^atfflent and 
p3^^yicui achiewm^nt l^vtl odcii^r^d* if I) 



* Beproduct ion^ supplied by BdRS at4 th^ b^it that can mad^ * 
: * ffroB th.i original dccuittsnt. * 

erJc 



CM 



Tochnlcal Note 79-5 



NAf IONAL INITlfUtI 

OuCiD iHACTLy Al AECflViD FNOM 

4tlN0lt PQINfi V»t\^ ew SPlNldNS 
iTAtlB m mi NiCillASILy ^iPNt « 
IINT Of PieUL N&flONAL iNStltuf t OP 
lauCAtiON l»9SltlON Q» POlICV 



Ddcember 1978 



Ul 



EFPECTS OF ORGANIZATIONAL AIDS 
ON LEARNING PROM PROSE TECTS 



Roy E. Main 



er|c ^ 



Reviewed by 
Jatflis J. McGrath 

h 

Do 

^ Personnel Raaaarch and DevelopMnt Canttr 

San Mago, California 92152 



FORKWORI) 



This rcBearch and development waa conduetod In aupporc of Exploratory 
Development Taak Area ZpjS-SZZ-OOa (Mechodology fof DflViilopniont and Evalua- 
cion of Navy Training Programs) and Work Unit ZPS5-52a-002-Ol,40 (Altarnaclvefl 
Co Formal School Instruction) under the BponBorshlp of tlie Director of Naval 
Education and TrainlnR COP-99), 

ApprQciAtlon is eKpfoaaBd to tho Uecruic Clnaalltcatloti Centar of the 
Naval Training Center, San mego, for aBalatanco In providing subject' and 
faellltlea for the conduct of this reaearch effort i 



DONALD F. PASJCER 
Comnandlng Officer 



ill 



SUMMARY 



Problom 

The Nnvy la tnvolvtid In A tnajof of fort to HyBtcmntlzc Ita mothotlB tot 
developing inBtructlonal courae work, An Important conaislorfltlon for couvm 
work dovelopfnenc Is the organlaation of Instr uc tlonal conhont Co f.ieilicuco 
learning, but few organl^flclonftl fltrfltoglos hdvc been Identified thnt cnn be 
.ipplled Hyytemuclfially In rcfll-lifo Inatruc tltinnl aettlngu. 

Roaefiruh has demonBt rated that the orgfinla/itlon of proHc content mn Iw- 
prove the learning of compldjt raUtionshlpB by brlnglnB rdlntcd atatatnente 
Into proKlmlcy. The rostruc curing of a passflgc to bring some related state- 
tnents togethBr may, however, neceasorlly sepiirftte others of equal relevance 
One way to almul taneoualy emphasize all of the Impoftanc relatlonshlpa In a' 
proae preBcncatlon la by syatematlcally nbstrQetlng and organizing the related 
polncs of Informaclon into simple graphic displays, 

Otjjective 

The objectives of the present study were to IdGnclfy and evaluate atrateglei 

for organizing prose contenc that appear appropriate for real-life trainina 
applications, 

Approach 

Portions of a typical high school science text were analyzed to idintlfy 
cypes of contenc relationships that might lend themselvea to graphic represen- 
taclona. Three basic typea of relaclonshlps were Identified; Associative (AR) 
Comparative (C.H), and Directed (DR). Appropriate sets of generalized behaviorai 
objectives were specified, and simple, easy-to-understand graphic forraati were 
aeslgned for displaying each type of relatlonititp. 

Three instructional treatnients were prepared: Text (T) • Text-Adjunct (T-A) 
wliere the text was supplemented by diagrams of CRs and DRs; and Text-Underlined* 
(T-U), where the Information contalnid In the graphic reprasentatlona was slnply 
underlined In the text. Groups of 56 Navy recruits, equally divided Into high 
and low science achievement levels, each received one of the three treatments 
followed by free-recall and nultiple-choice perforinance tests, it was hypothesiz 
that T-A triatments would be superior to both 1 and t-U treatments, especially 
for students with previously low levels of science achievement. 

Findings 

Findings were equivocal with respect to the advantages of supplementing 
prose text with organizational aids, The only condition where the T-A treat- 
nent was clearly superior to both the T and the T-U treatments was the free 
recall of DRs. The T-A vas also superior to the T treatment in terms of multiple- 
choice test performance on CRs, For this condition, however, the T-A was not 
superior to the T-U trfiatment, Indicating that the advantage resulted from draw- 
ing attention to critical points of Information rather than from reorganizing 
that information. No Interactions between student ability and the effects of 
the treatment were noted. 



Com lmLom 

S'lndlnge faildd to confirni a Btrong and coriBlatcnt: ftdvantttBe for yriipltlr. 
organiEfltlpnal aldd uadd mi supplewenta to typlcnl proMe iniiuructloni thti 
effedtR df th^ aids my havd litduti wenkendd by the rylntivc'ly btief Hl:udy mi 
r^Hciiitlon pdrladsi tttid bacauiiG the doursa dontuiit idekod rdlyviincs For 
the studfintB. It voh concluded thflt alternative condltionB for proBcntliig 
and testinB the effectB of tiuch organl^at tannl aldii Hhould be Invent lefltyd. 
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INtRQDUCTION 

Problfltn 

A major effort is being mdo within the Mavy (aa well aa within othor 
fliliitaify and civilian Qrgani^atiariB) to aysten^tiaG methoda for dGveloping 
inscruetlonal presentations, thia effort my bo appropriately viewed as an 
ittempt to cenvart m art into a tachnology. In the paat. It was typiaally 
assumad thnt any litarata subject-matter eKp^rt could prepara offdctiva eouraa 
vork based on a subjective Judgment oC what constitufcos effective instruction* 
However, aubjaative Judgment has pieovan inadequate for tha dosign of offective 
cQurs© work, Rothkapl (1963), in fact| found a strong nsgativo cdrrnlatlon 
batwaan aduaators' ratings of instruct ional materials and the materials^ actual 
ef fectlviness as datermined by student patformancep 

Efforts to systematize and objectify the process of Inatructional develop- 
ment have led to the constructioii of numerous course developmant documents 
such as the Navy^s Interservlce Procedures for Instruetional Systems Devalop- 
mtnt (1975) andp in the civilian community , the CORD National Research Train- 
ing Manual, developed by the Teaching Research Division of the Oregon State 
System of Higher Education (Crawford, 1969). these documents emphasise be- 
havioral analysis, including the isolation of specific learning objectives that 
students must master if they are to achieva the goals of the instructional pro- 
gram. At some point p however ^ the proceas of analysis must change to one of 
synthesis* Once the behaviors that atudants must perform and the information 
that they need to perform those behaviors have been determined^ content should 
be organised to facilitate understanding and to promote retentloni Thusi 
synthesis is the reorganization of analyEid content Into effective instruc- 
tional presentations i 

An important consideration in organlaing course work la the type of learn- 
ing condition Involved. Any single method of content organlEation (such as the 
Sklnnerian "programmed approach*^ may not be adequate for dealing with the 
variety of learning conditions thet occur In real life. The changing of in- 
structional techniques to match condiciona of learning has been advocated by 
Gagne (1965) in his Conditions of Learning , Gagne suggests that one of the 
reasons psychology has contributed so little practical knowledge to the field 
of education Is that each theorist has tried to eKplaln all types of learning 
behaviors based on research perfortnad on a single condition of learning. This 
position raises serious questions with respect to studies of content organisa- 
tion, m^h of this research has dealt with learning tasks that are not rep- 
reientative of classroom instruction; thus, to assess the relevance of such 
research, it is necessary to determine how the effectiveness of organisational 
techniques varias ^th respect to conditions of learning. 

Objective 

Systematic methods are needed to guide the organization of Instructional 
content into effective presentations. This study's objectives are to review 
mjor areis of research Involving the organisation of prose, to discuss the 
Implications of research findings with reepect to interactions between organiza- 
tional strategies and learning condittons, and to identify and evaluate organiza- 
tional strategies that appear appropriate for real-life training applications. 
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Critical MM lit iH^om Oriiani^iitLpn 



Lyy y I fl at Oy mn Lmt la n 

It aliauld bu Qbvloua that thy organisation of ptom eohteiit can In- 
fluenci instructional eifEgetlvdntflfli foif eKaittple, a rdtidom aaglgnment of 
words within a paragraph would undoybtedly vtiduce the dontatit's Intolllgibillty, 
On the Qthar hanti^ a changu In the otderli\g ot Independant dhapteirs lit a aclonoy 
text may havte little ^ffact. In mast atudlGa ot proM organlMtlon, md In 
tha prua^nt study, lntar«st Is foeuByd at a lev^l butwaen thdsd two ekttemoB, 
particularly at the gancencc ot atatoment l^val whavd facta, rulus, ^nd eon- 
copts are pHpresssdi 

An lasue cloaaly relatyd to levels of proie orguni^atlDn Is cho dom- 
pUKlty of the learnlagt Gdgne (1965) descrlbys learning content as baing 
hlerarchleally related* Hulesi tot eKompUi repreaant a higher ordor of con- 
tint thari concepta since rules are constructed from conceptg, Similarly , con- 
cepts represent a higher order of content th^rt associations since eonQ^pts are 
formed from related ^asoelatlona, Gagne ouggeflta that ilmplOi lower-order con** 
tent must be learned before compleKi higher*orddr eontenti Instruetloni he 
maintains I should be saquanced from the simple to the complex to oneurQ an 
appropriate ordering of learning eventsi 

Types of Qrpnlzation 

The categDrls^aclon of types of organisation has been discugeed a^ten- 
slvely by Lee (1965),, who Identifies thrw major strateglea for or|ani^lng 
instructional contents unity, aequincep and hiitarchy. "Unity" refers to 
placing toplcaliy ralaead ideas together in a paasagti ''sequencei" to ^hm 
loglQal ordaring of tdaaa; and "hierarchy^" to the degree that some Idaaa are 
"more encompasaing" than othirs. It would appear that Oagne's emphaals on 
learning dependencies, and his model for structuring inatructlonp are more 
closely related to what Lee refera to as "sequence" than to "hierarchy." 

Purposes of Qrf^ani^ation 

Merrill and Gibbons (1974) have potnted out that prose may be DrganlEed 
for dlfferenc purposes or with different polnta of emphasis* For eKample, Gagni*i 
hierarchical anaiysls, which emphasises relationships among different Levels of 
con tent J typically raaults in a structuring of sequences of learning behaviors. 
In contrast to Gagne, Merrill and Gibbons suggest a haterarehical analysis that 
indicates content relationships without specifying any particular sequence of 
learning behavior, A heterarchical approach would, presumably, be appropriate 
for analysing relationahlps at any given level of content as well as between 
different levels of content and, therefore, would have a broader application 
than Gagne^s model. Since no specific ordering of learning is preaerlbed, the 
heterarchlcai analysis has the further advantage of allowing the learner to 
select his preferred learning sequence, thus providing some degree of individual- 
Ization* 

Meanin^fulness of Relationships 

Wien prose Is organized to depict content relationshtps, a point of 
consideration is whether the relationships are meaningful or artifactual. 



EKLC 



Somfi d£gAnl2«tlbnai Btfdteglei baaed on cluitactirlstics i\m Ate if'' 
»fii*v*nt to ah unditf«t*irtillnH of the eontent but aid thg studertt'B ratentldh 
ot th« cotttetic, Pdt axatople, a muile teadhet helps BtudtntB to leatn the note * 
that Ull in the apacea of tha treble eleff by pointing out that thiy ipell 
out th« word PACK, The wed la an artiladt. It la not n part af what Is baliiri 
l««rn«d, Such artieietuttl relatlonahlpg ite comtnonly tefafrtd to aa mnsmmiei. 
K pavlew of tha uaa of wfiameinldg for inptoving tfetBnclon h&n h»m pifovided by 
Santer (1965). r ^ 

$mn otganlRfltionfll BtrtttcglcB foeua on relatlonahlpi that are iiiaaftlng^ 
ful With raBpeet to concent, Recognlalni auc-h rBlatlonahlpa way allow cha 
Mtudttnt to deal wtth thtt aontfiftt mera afflclentiy, For exaojpio, rBcogniilng 
tha cofnfflonality df Invifttlon In fractional dlvlalon problema allows one to deal 
with all fraetlonal divlaion problemi. Whethor a fraction la simple or cott- 
poutid, the dlvlaor should be Inverted aa a part of the fflatheinatlcal oparatldna. 
Knowlad^io of tha comooniillty of thla raqulrement graatly raducaa the aitount 
of Information that wuBt bi retained to parfotBi luah coniputatlona. In thla 
case tha relationahip la not laarnad aa an aid to retention but aa a meaftlng- 
tul speratlon in dividing frfletlonfl. 

In dipldting content relationBhlpa to faflllltato learning, course 
witera typically look, to neflningful ttlattlonahlpB Inherent within tha content* 
Areif«etual ralationshlpa aro uauolly oonatructed when no odequace, meaningful 
rttliitlonahlps ara available. 

Ixplle It n ea g of pr^an Iza t lo n 

According to Ua (1965), aeructure la elthar implicit or explicit. 
It ta IsipliQlt when it la not raeognlied by the atudont; and when impllelt 
structure li revealed, it becomes explicit. Structural relationflhipa may be 
ttada explicit either by directly Identifying them or by organizing the con- 
ttnt to bring the relatiotiahips to the attantlon of the atudent, Career 
<Kot« i) points out that a number of atudieB (rhompson & Tulving, 1970; Tulvlng 
li Oaler, 1968; Wood, 1967) have reported that relationBhlpa between items aro 
efltctivi recrieval cues only if chey are made explicit and atored along with 
the ifceins that are to be recalled. 

^tonlpulatlng Prose Organization 

Oc&anizlng Prose to Structure Behayior 

One of the major methods that haa been used to facilitate learning ia 
the manipulation of prose organiiatlon. in a number of atudiee, the mantpula- 
tlon^B purpose was to structure learning experiences. Moat such InvestlgationLa 
are based en the premise chat learning complex tasks requires the previous 
acquifiltlon of simpler types of behavior. Gagne'a hierarchical model of learn- 
ing has provided the eheoretlcal background for many of these studies. In 
tetoa of establishittg an optimum ordering of learning, however, results have 
bean iqulvocal. While a nuobie of studies (Gagne, 1962; togne 4 Wlegand, 1970| 
Gagne & Paradise, 1961) have demonstrated that students who fail to learn pre-' 
requisite skills fall to learn highsr-level tasks. Carter (Note 1) points out 
that such atudiea are in reality concerned with what is learned rather than 
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WitH Ihi 0tiier tsf Ib^rnltigi thAt is, they Ihtlititti that soitie tftaks turthot 
b# Itearftiid unless dettalti lubpottlorts At4 leatnedi but they dd tiot Indlcdti 
thdti me leiirnlng sit^uence is better ttmrt rttibthirt Studlga thrtt have dttemptid 
Id difftftftslrdte oNer dgpenclendles In leAming have bein leis suceeiwfuli In 
r^vie%^lng eight etutllis thAt wrtnipuUted the ordet df learning events j 
Nltde«\ey#r (196B) found only one {Um^ 1962) ahoi^ing d slgnlflcailt achieve" 
i«ent iailvftnCAge tot a IdgtcAlly SBtjueneiid proRfafti, th^ othi^ seven (RMthferohl, 
Pdyttii ^ fiordun, l96?i Levin a naker, 196Si MlUeri Mdti 2| Mledemeyer* Brdwti, 
A SuUen^ 19691 R«#, Case, Si Roc, 1962| dtolufov* 19f)A| lind WcMtkei nmm, 
SamNi Vrederlcksi 1967) report^fi no dlfferenoe in poscwst pitfotmdncg for 
ritudtintM receiving logically urdeied veriius Bcrnmbled sequind^ii 

Additional dmibts to the general acJvlsabllity nf atrudturlng iwrn^ 
Infi ^iMpgflene^^ ftotn the iimple to the edinplijc hav6 befen Mlsdd by Sddndurii*s 
iA>rk In mathemntldB inatruatlon* Seandura (1973) designed an entire m^the^ 
rtatlds course by (1) apeclfylnR all of the essentlnL rules Involvtid tn th^ 
Instruetloni (2) Identifying patalleli among chege rulesp and (3) develnpltig 
hlgh«f*order rules that allowed itudenta to generate the lower-otder rul«. 
for ^Mttiple^ one ht|her*drder rule ■'shawed how rules tot converting between 
nufli%«l» In arbitrary number bagig Ct*g,# 2^ 5) ean be derived from a single 
rule tot conv^rtingi sayi between bafle 10 and bagg 8 nuwerala*' (1973| p. 10). 

Ehr«nprels and Sdandura (19? 2) found chat Itearners who wera taught 
only a tridud^d sat of higher^order rules perforfftid as iffeeclvely ag liarners 
who mm taught the eomplete lec of lower^drdet rulfts* These flndlngi do not 
negata Oagna^i position that gdme tafika can be reduced to aetg of subtaski 
that must MOh ba mastared if the 0V6rall taak la to be performed effectively. 
Howeveri sudh findings do ddfnonstrate that the performanca of complex higher- 
ordur ikilla ig not always dependent upon the prior mastery of related skills 
at A lowdf eonoeptual level* 

Orga.nls£lni^ Prose to Clarify Relatlonshipa 

Dangtiteau^ Evans^ Wrlghti Long» and Astkingon (1974) deaorlbe a widi 
variety of attategles that have bean employad in organizing prose eontent, 
Soma of thisa strateglag appear to be mora concerned with the clarification of 
content relationships than with tho structuring and eontrol of learning be- 
havlora. The dlatinctlon between content- and behavlor-orlinted instructianal 
approaohaa has been cniphaalzed by Merrill and Clbbong (1974) who contrast a 
hiararchleal analyaisi which specifies or implies an ordifing of learning 
objaottvesi with a hitararchlcal analysis, which gives the scudent ''a repreien- 
tatlon of the subjeet matter which facilitates his cm storage and retrieval 
of Che content In memory" (p. 146), In Lae's (1965) terminology, the purpose 
of a heterarchical approach to prDse organlEatlon is to make Impllolt content 
eitpliclt, However, atCempta to clarify relationahipa by tfanipulatlng content 
organiiatlon have yielded mixed reiultSp depending upon the characteristics 
of the content . 

Iterd Ligts, Efforts to demonatrate practical advantages from organlElng 
prose to bring content relatlonahtps to the attention of the itudenti derive 
from studies of clustering effects in the retention of word lists. Bower, 
Clark, ^Inaenn, and lesgold (1969) presented groups of words to students for 
meoorlgation. The words could be scructured Into conceptual hierarchies. 
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Rtcali V4as sup^rLcr i*h#n wo^d ^rg^irit^tions were orgaaigid aecotdlng to theie 
coaceptu^l bla7ar'<hl«€i rstli^r chan Co raadom mssl^maiitei Tlve Jtudints also 
^ tindid to recall tha lo^tBYlml In ^ hl^rarehlcal orde^p proc€sdL^S Ctmm in* 
cluMi^% £Qii€ipt§ to lo^tr^lev^ tvita»cii of eonempts^ Ii ^as hypothealaad 
that «aogiilttcn «f the rtlattOTililpa provided cues for racalllsig the mi« 

Tul^lai aaid Itjirlaton^ (LS66) provided further evideacft of tht effects 
of ^rganiztCiM list t^trdivaSt Word lists of 24^ cr 48 words 

ofgaatiid l^to catigoties o£L^ Z^or 4 %rords were prag^ntgdi raeall, only 
haXf t:h^ eutj^^tp ^mn g£vw tKi c^tigory mmmmsm FoLlowlns the ialtlal 
recalLp all si^j^cts v^rs gtv^ tlii c^Ugory ames«. Results indicated that 
ptQ^iaing cdtegotjf MD^s at tl^ tAm cf recall facllltateB the ^atrlsval of 
Individual %0ordB^ nii^e «^ulta ars tfonilstent with thfe hypothesis that the 
knowl^dg^ off ralutlMniblpa mi^ni wrdie facilitates tlielt ritintioti, mxid further * 
diMfts^trmti thm ixpoi^tmn^^ ^king fiUQh relationships available at the timm 
of fscrievtli 

^d_^jegdMit iPtpit Stat^ffl jstg* to the basis of Mali word*retatitlaii 
atudlMp Ct^tesr {Votm %) attfiiljptid to diionstrM^e slmllaT fac3lldtatlv€ effeeti 
for hlarsrclmlcal xiLatlcnahtps In pro^ii For cKls purpose, Carter created 
prose jaasages dt^cribUii a ficticious Indian tribe thi "HltBocta," Tha 

passage consisted q± relattVily indepindent statemants that aould he grouped 
according hler^rafcically ttlated tapie areas. 

c-otitra^t to tha \«td^l£st «tention etudles (^mmm mt al, , 1969; 
TuLvlttg S t^rlstane^ 1966) ^artt^ foiand no advaQtage for a hlarareMcalLy 
ordered pri^ntation* leartLing nmtB also failed to prodtice il|nl£icaiit dlf- 
ferancas in taat perf orffiOica=# 1^ i f ^Uow-up study by Carter and Garrlsr 
(1974) ^ evid4nai af msi adv^arrtage Cor a»rgani^ed over randca presantatlca wbb 
establi@li.ed^ b%3t anl^ v^hett t«plc taiidCngs were identified for the subject, 
and only t^h^ three expoitfri^ pf the p*ai8ages were given* 

Coi ^jli3g P^os^ ttelatlcins h lpig t Ihe f Indlnga of Carter and Carrier 
certalolr do not indicate a ^obusc affi'iat for organiEatlcaj arid appsar par^- 
ticuUrljr dt^Qour^ging in teams off pra^etleal appllcati©ns» Tbise authors cent- 
pared wadott Dirdaa^lngs of ^t^tsfftrt^ti «galnst the strongist , TO8t btnef Iclal 
ord^rlsgs th^t th^y eoiild de'^lge, In jractleey most prow pmsentatloiii are 
already orissalzid to lom digreei cout^s writers typically pT^ient concepts in 
a legiaal fashion mA group ^itails^r t&glcal content together # Por an orgatilza*^ 
tlonil itTtt^g^ toi hm practieil^ trt wmat produce resists that compare favcrably 
with the pre^alllag mithoda of pro^si paiientatlon. 

Perhaps ttai iwafcnesg of Ca^a^tr ind Carrier' m results be attributed 
to concent si'^iidt^i As tfaey^ th«iise^vii suggest, '^before th.^ afffeets of 
organisation^ charaatfttflstles of jrog^ can be adequately stwdied, the exper- 
lineatal partdi^ irllL h#vs to l^vgnve materials of greatar co^lejclty and longer 
duration" (1974 i p, 48), Sooos avtdinc^ of stronger orgaQlwtlcMl effects for 
prose with aore coapLicdted cyp^s mt c^nEent relationshlpa has, in fact, been 
estatllahad, Kiialir and llsyd (lS?4) ^ for example, fouad that SMMbllng 
affected Chi leaniinB of lnt^riiels«idi Brose sentences but not indapendint ones. 



sl3 



Further evidence of the effects of prose organization on the leamlag 
of coiBplax eon tent rela tlonshipi has been provided by a series of studies 
following another line of risiarch CFraae* 1969, 1973j Schultz & DlVesta, 1972; 
Prtitoaft 4 Greitier^ 1972 j ^eacSp JsEdeck, S Coulionj 1973), In these studies 
content coosleted of m. tiuober ©f Eiibject namei^ each of which was aeslpied 
specific Gharacterlstlcs with respect to a nuober of attributes (e*g*s a group 
of flctltlQus countries th^c dlffeT with respect to industrial and geograplilcal 
attrlhuteSp or a group ef fictitious fiah that differ with respect to general 
physical actributes)* Besults of theae investigations demonstrate that ofganlE- 
ing passages according to some structural characterlitlc of the content dnes 
faeilltaM recall* All four of those experiments that compared presentation 
organlzid by name or attribute agalnit a randoa organisation found orgaaiw^ 
tlon by attribute to bt iuperier to random prisentatlon. Three of the eicparl— 
ments (FMse* 1969| Myers et al, ^ 1973; mi Schults & DlVesta, 1972) also fouBd 
orgaalzation by nwie superior to random presentation* 

The advantage of the organised presentations may have been related to 
the way the subjects Drgantied their recall* two studies (SchultE & DlVeetai 
1972; Friedman & Grelt^er, 1972) found the clustering of reaponsea at recall 
to be congruent with the order of presentation. 

Fraae (1969) also reported advantages from providing advance Infotma^ 
tlon coneerning the superordlnate strueture of his presentatloni but these 
findings do not support Ausubtl's (1960) arguoents for advanced organigerB, 
Prase "S affects were obtained only for the second and third presentatlana of his 
content I At these points, information on the superordlnate structure had beeii 
preceded by presentatloni of specific content* Effecti of advanced organtiers 
can be determined only under conditions where the superordlnate structure 
precedes the content, 

Ai noted prevlouily, there la little practical value in demonstrating 
that an organized prose presentation Is fflore effecttve than an unorganlaad 
one. A ffiore critical matter is whether some oethods of organization are better 
than othars* Two studies (rriedman 6r GreitEexi 1972i Myers et al. , 1973) did 
report higher levels of free recall for attribute-organlEed than for nama^ 
organised passages , but Friedfflan and Greltier attributed their results to 
hierarchical relationships amoog the attributes and warned against generalis- 
ing these findings to other typss of content. rurtheriDorei the advantages for 
attrlbute^organlzed paisages* ai report ad by Myers tt al*^ varied from one 
eKperimint to another and were dependent upon conitant maintenance of the i^rlal 
position of information — a requlrtcient not usually satisfied by typical prosa 
ins true tlon* 

Frase (1973) Initially found thati when variations occurred in the 
Beffianttc structure of sentences i organization by name was superior to organl- 
2a tlon by attribute. In further escperiments where the saTOe values appeared 
under both name and attribute i variationi In serial position wera more 
disrupt Ivi for naffie-or|aniged preientations. Clearly p for free recall, , 
nelthar method of organiiatlon appeared to have a strong and consistent 
advantage over the othir* 

Free recall may not be a good criterion for Instructional ef feetlveniss, 
typically, the student is expected to do something more than recall isolated 



faeCi. Hi is alap expecttd to relate these faces Co each othar and, per- 
haps, to apply them iii some mg-xt of task, With respect to the integration 
and applldatiott of iaformation^ the advantages of organlgatiofi are less well 
docuMttted. Fraae (1969) found no advantage for organized versus unorganised 
passages la teaching iubjacte to recognise appreprlate cheis noves. la a later 
studyp however, Praae (1973) was atle to establish that organlMtion can aselst 
the subject to answer queitlons t^t rtqulre the iatsgiation of Information. 
The fflore effective organlzattooal strategy, In this case, is the one that 
brings the Inforaatlon Into proximity vttMn the preaentatlon. 

In cases where it li Inoportant to struature prose instruction to bring 
relactd infcraatlon into prosclmlty. It la relevant to consider nethode for 
identifying and assigning prtorities to content relacionshipi, Dansereau et al, , 
(1974) describes two approaches that ha\r€ been conaidered for this purpose. 
One involves methods for degcrltlng the semantic atmcture of text passages by 
"separating the structure Into underlying componants represent Ing semantic con- 
tent and superfielal eoapongmts eorresponding to style" (p, 55). The other 
tnvolvea multldtoensional sealtngi a method for ''obtaining Judgniente about the 
extent to which palra of iteaa ate related" (p* 56) , 

While such approaches appear useful, they shoiild not be eKpected to 
eliminate probleiaa aseociated with the structuring of Instructional prose con- 
tent. Whatever method la used to Identify Important content relationships, 
the course writer Is left with the dilsMa of bow to bring iome related facts 
together without separating Pthets^ Purthermorej if superficial prose con* 
ponents are minimised to clarljey relationships httween meaningful content 
there Is risk of producing a prose ityle that is tedious and dtill. 

Peplctlng Content Belatlonahlpa 

All of the studies cited mo far have attemptid to clarify content relation— 
ships by Mnipulatlng the organisation o£ proas prssentatlons* Another method 
Is to depict the critical relatlonshlpe separately from the prose passagesi 
In general, methods for deplattlng content relatlonahlps may be separated into 
two categories J those that deplet only the superordlnate structure of the con— 
tentp and chose that depict iptclfic concent relationships, 

Superordinate Structure 

Superordinata structute refers to content relationships at a higher 
order of abstraction and genetaXlMtioa than those to be learned by the sub-- 
j^ct. It has been clearly eftabllshed that a knoi^lsdgt of superordlnate 
structure can facilitate proae learningi Although' Gagne and Wlegand (1970) 
demonstrated that reaall of prose content improvad when such hlgher--prder in- 
formation was provided at the tine of recall, provldini superordlnate structure 
at or before the ctoe that Instruction is prasentad has resulted in negative 
or inconclusive rasulta. M early etudy by Eobinson and Hall (1941) found no 
instructional advantage for tht addition of paragraph headings* A later study 
by Christansen and Stordahl (1955) found a similar lack of effects for state- 
ment or question headingSi pra- oc post-siJaaarlgSp outlines^ or underllnings . 
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A study by Lee (1965) claimed facilitating effects from the addicion 
of paragraph structure (Introductioni , siamatlons, underliried headinggp and 
transitional paragraphs). However, Carter (1972) polats out that: Lee's 
faclllcatiy^e effects only occurred with essay queationa on main Ideas/ Per- 
fomanee was not enhanced for recall or recognttion of more detailed lriforma» 
tloxi ^tthlci the paisage* In Lee's stud^, than^ the superordinate structure 
did not eacilitate the learning of eubordinate informatloni but rather the 
learning off Inforiaation related to the superordinate structure itself* 

Gagne (1969) claimed facilitating effects from providing superordinate 
Infomattoa at th& same time that the aubordlnate information is presented* 
He preieated fourth grade students with science facts emhedded in four related 
coordinate aentences or In three coordinate sentences with one superordinate 
topic seatMca^ Subjects recalled the facta better when a superordinate 
senterice was included ^ However ^ Gagne's results could be Interpreted in terms 
of retentlo'n requirements rather than superordinate facHltatlon* The super- 
ordinate aentence my have been viewed by subjects as information that did 
not have to be retained. This would require them to remember only three rather 
Chan four sentences. 



Another series of studies Inveatlgated the depletion of superordinate 
structura before the instructional ejcperience. These studies were based on 
Ausubel'a pesltion that advance organizers (Infonnatlon "at a much higher 
level of abstraction, generality and Inclusivensss" than the Information to 
be learned) facilitate learning by allowing the subject to Incorporate new 
material Into eKlitlng cognitive structures (1960, p, 271), Ausubel's find- 
ings indicate that subjects who received such advance organiiars performed 
slgiiif icantly better on a test of the content of a learning paaaage than sub- 
jects who did not, even though the test performance of subjects receiving the 
advance organlEeri alone was only slightly better than chance. Carter (Mote 1, 
p. 2 6) polnti out that replicatiana of Ausubel's study either found confound- * 
Ing facllltatlve effects from the advance organizers (4uaubel 4 Fitzgerald, 
1961) or neglected to determine whether the advance organiser had a direct* 
InstTuctlv^t effect^ "which confounds any interpretation of the effects of the 
advance organiger on learning from the instructional passage itself This 
latter group of studies includes investigations by Allen (1970), Ausubel and 
Fitzgerald C1962) , Ausubel and Youssef (1963), and Schulti (Note 2); 

Specific Relationships 

A second category of atudiea has not been limited to the superordinate 
structure off the Instructional presentations but has depleted relationships 
among the specific factual elements to be learned. Evidence of facilltative 
effects frorat such depictions was provided by Scandura and l^ells (1967) ^d.th 
respect to mathematics materials. They referred to their depictions as advance 
orgaaizgrs. However, Carter (Note 1) points out that. In terms of ^subel's 
(1960) theoretical position^ advance organisers should provide structure at a 
ncre general level than chat of the material to follow* Therefore, Scandura 
and milm support the depiction of the specific relationships to be learned 
rather than superordinate structure In the form of advance organlgerSi 

l^thematical relationships obviously lend themselves to symbolic depic= 
tlons, Howver, any type of relationship can be abstracted from a prose con- 
tent md depicted graphically. Since graphic representatlona can present all 
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critical eltmente In proxiniltyj they should facilitate» according to Frase 
(1973)i the learning of such elements. Representations such as tables, 
matrices, or algorithms arei of course, in comon use as instructional 
materials. In the past, however, few efjEorts were made Co evaluate the ef^ 
fectlveness of such devices, to determine the limits of their advantages, or 
to devise syetenatic approaches for their application, (It is Interesting to 
note that studies comparing name^organlaed and attribute^organlzed presenta'^ 
tlons all used matrix diagrams in report Ihg their investigations but did not 
evaluate the diagrams as methods of Instructional presentation • ) 

A. few recent research efforts support the value of graphic represen- 
tations that sunroarize content relationships. Gropper (1970) found that several 
types of verbal dlagratts (l,e*, labels, short phrases, hlock diagramSp and 
arrowed lines) all produced better learning of verbal chains than an undefined 
"conventional inetruction« Holliday^lI^fl976) found that both a pictorial pre-- 
sentatlon and a word--diagram presentation resulted in better learning of a 
series of cause-and-ef f act relationships thati did ttKtuaL descriptions* In 
these graphic repreientations, Holliday replaced connecting wrds and phrases 
in the tesctual descriptions with line drawings or block flgurea and design 
elements, "thereby increasing the theoretical chances of mental linkage forma- 
tion among verbal labels" (1976, p* 73), HQlliday-s approach brings together 
informational elements that the student TOuld need to integrate in order to 
satisfy test performance reqiiirements. In this respect, his methods are sup-- 
ported by Frase*s (1973) studyt 

Unfortunately, Holliday provides no information corieerning study times* 
The possibility that subjects received longer study sessions with the word*- 
diagram and pictorial presentations than with the teKtual prose cannot be dis- 
counted. 

Comparisons of prose Instruction and graphic presentations have not 
always favored the latter. Wright and Reld (1973) compared a flowchart 
algorithm^ a two-dimensional table matrlK, and a series of short sentences 
against a "bureaucratic" prose style* The content concerned various fictitious 
methods of future travel. The task was to select the best method (e^g., fastest, 
cheapest) for a particular set of requirements. FJjidlngs Indicated that reten^ 
tion over time was superior with the short aentences. 

It la not unreasonable to expect prose presentations to be instruct- 
tlonally superior to graphic representations In some sltuationa. Prose, either 
spoken or written, is our most coiranon form of confflflunlcatlon. Furthermore, 
some ideas are difficult to syniboll^e graphically* New concepts often have to 
be explained In detail, perhaps with examples or with analogies to previous 
experiences, A reasonable practice might be to combine presentation formats. 
The prose passage could be used to introduce concepts and explain relation- 
ships in a typical textbook fashion, and the graphic representations could 
provide a summation and clarification of these relationghlps by eliminating 
nonessential elements and grouping essential elements. 

^though the use of graphic representations to clarify relationshipa 
contained In prose passages Is not a new concept, the potential utility of 
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such procedures is still a matcer of conjecture, We are. In face* only begin- 
ning to syatematlGally inveitigaci the benefits of coDablning text with graphics. 
To date the findings have not been encouraging. In a review of recent writings" 
on the instructional applications of diagrams^ Holliday (1976) atatasi 
"Surprisingly, recent diagram and attention theory and research suggest that 
a single flow diagram alone with instructive questions constitutes the most 
effective presentation" (p, 64). 

Holliday' a conclusion la largely based on studies of attentional be- 
haviors (Fleming, 1962| Anderson, 1970; Sdmuelsj 1970) suggesting (1) that, 
given a choice of cw instructional formats^ learners tend to select the one 
requiring the leaac effort, /and (2) that most learners generally favor the 
tt^tual portion of books over adjacent pictorial displays* Holliday 's position 
Is supported by his own findings (1976) that combinations of diagrams and text 
were less effective than diagrams alone, and no mare effecclve than text alone. 

Stilly Holllday's findings leave two major questions unanswered. First, 
if the materials were presented in auch a manner that the students were forced 
to study both types of presentations, would a dual mode of presentation then be 
facilitatlve or would It set up Incompatible learning strat^igles and reduce in- 
atructional effectiveness? Second, would a simpler type of graphics than those 
used by Holliday be more beneficial for use in conjunction with text ? This 
second question is important because Holliday claims that student i prefer prose 
to diagrams because of the latter -s relative complexity. An eKamlnatlon of 
Holliday' s diagrams makes the students* preference understandable—the diagrams 
vere eKtremely complejCj making the eKtractlon of information difficult* Since 
one of the main purposes of providing graphic representations is to simplify 
compleK relationahips, a aimplar type of graphic should probably be used in 
conjunction with teKt, 

A final point of Interest regarding the effects of organization is 
student learning capacity. Although etudies provide little evidence of inter- 
actions between learner characteristics and content organisation, such inter- 
actions should be expected. Carter (Note 1) argues that one of the reasons 
that aanipulations of text organisation have failed to affect performnce is 
that the learner has a robust ability to reorganise content mentally* Since 
poor learners are probably less proficient at organizational skills than good 
learners, they should benefit more from organisational aids. 
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The pteseot study was coaducted to determine whether or not organiza^ 
clQoal adjuncts in the form of graphic representstiona of conceptual rela- 
Cloaihlps enhance the effectiveness of tastructional prose. Although the 
Intsmtlon waa to Implement aftd ivaluate such adjuncts imder real^llfe In- 
strucctoaal conditions, it pro\rad Ittpoislble to obtain enough subjects to 
train and test ovar time with nianingful Job-^related content. In practice^ 
therefore, realistic conditions could only be appro^liaated using abbreviated 
training and testing peripds and course work that was likely to be unrelated 
to the subjects' job assigmnenti. These necessary deviationi from the ideal 
coadltion must he eonsidarid la dra^ng conclualons from the eKperiment, 

Design 

The axpertaental design called for comparleona of three instructionaL treat 
Mats md for two levels of achievement on a general science test. The three 
treatments were (1) T^t (T>, conventional textual prose passages | (2) Text* 
^junct (T-^A), the same passagts supplemented by adjunctive organizational aids 
(l.e,, graphic representations of related statements); and (3) TeKt-Underlined 
(T-TJ), the same paseages supplesiented by underltaed passages setting off those 
statements that constituted the graphic representations for the T-A treatment. 

The T-^U treatment was provided to determijie whether or not any facHttatlve 
effects could be attributed to selective attention. If the effect of organi^a^ 
tlonal aids Is siaply to direst the Btudent's attention to critical portions 
of the Instruction^ then a similar facultative effect might be eKpected from 
identifying critical Information without TOdifylng the structure of the in-- 
struatlon. 

Identifying high and low aehlevement groups in terms of general science 
fcoowledge served a dual purpose. Fir at, it allowgd a statistical accounting 
for part of the within-subject variancei Second, it provided a means for 
identifying possible interactions between organization and study skills. It 
is possible that students with higher levels of general science knowledge have 
aaquired laore effective strategies for retaining the complex content ^relation- 
ships that one often encounters in explanations of scientific phenomena* If 
such Is the case, then clarifications of content relationships would be inore 
beneficial to low achievers who have not developed as effective a set of study 
behaviors. 

Subjects 

The subjects were 224 Navy enLlsted personnel from four recruit training 
coapeniest These peraonnel rtpresent a broad range of academic abilltlei and 
technical backgrounds* Participation was voluntary, but none of the persoimel 
lAiQ ware solicited refused to take part in the study. 
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Materials 



Text 

The baalc InstruGCional content was adapted from a high school genaral 
aclence text (Davis, Burnett, 4 Gross, 1961) used by the United Statea ^med 
fotamB Inaticute as a part of its General Educational Development series. The 
paaaages selected^ all concerning the formation of weather conditioner covered 
four different topics i movement and characteristics of air masses^ develop"- 
sent of acorros, ivaporation and condensation^ and meaeurement of relative 
humidity. Some changes in the wording of the original text were made so that 
statements could be lifted out of context and organized into a diagram with 
only minor granmsatlcal variations. 



Content of Q rganlzatiot ^l Aids 

The organlEatlonal aids were developed as follows- Flrst^ the passages 
were eKamined to datermlne the types of relationships that would be relevant to 
an understanding of weather phenomena. Three distinctive types of relationship 
were identified: 



1. Associative Helatlonships (Als) , which establish connectlona between 
a subject (e.g. person, object) and two or more attributes (e.g., a hygrometer, 
which measures relative humidity, consists of two types of thermometers, 

and responds to changa in temperature and TOisture). 

2. Comparative Relationships (CHs)^ which provide comparisons of two 
or more subjects with respect to one or more attributes (e.g,, tornadoes form 
on land I waterspouts, at sea)* 

3. Directed Relationships (DRs), which relate cause and effect (e.g., 
an increase In relative humidity reduces evaporation, which lessens the cooling 
effect of evaporation on a wet-bulb thermometer and raises its temperatnre) . 

Mter the apajor types of relationships in the text passages were determined 
the content of the passages was reviewed to locate all eKamples of each relation- ' 
ship. The review was conducted separately by the author and two research as- 
sistants. Relationships were designated as AR, CI, or DR only when there was 
unanimous agreement among the reviewers, 

A general type of instructtibnal objective was specified for aach of the 
three types of relationships. For ARs, the objective was to be able to choose 
correct attribute values for a given subject (e.g.. Do hygrometers measura 
hunidity or relative humidity? Do they consist of one or two types of ther- 
mDmeters?). For CRa^ the objective was to choose correctly the attribute 
asioclated with a subject or set of subjects (e.g., Which types of storms are 
caused by a rapid Increase and which by a decrease in temperature? Which 
storms form on land and which form at sea?). For DRs, the objective was to 
Indicate correctly the effect of a causal factor In a chato of events (e.g.. 
Will an increase in evaporation raise or lowr the temperature of a wet-bulb 
thermometer?). 
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Format of Organizational Aids 



- . °'f«nl«^tional aids ware d.veloped to serve as adjuncts to the printed 
teat materials. The development, while guided by relevant research ftoSl^r 
was largely a process of trial and error based on the opinions of the loves tL- 
gators and on the riactlons of Navy enlisted personnel who participated In 
pilot .valuations. Since one of the major reasons cited for previous failures 
of organLatlonal adjuncts was the relative complicity of the graphics (HoUlday 
as poasibSf """^ " ^'"P "^^""^"^ '"^^ ^ stral8htf.4rf ' 

Each relationship la the adjunct was introduced by a title IndlcatlnE 
^^dl!!??^f^h «ea (e.g., Movements of Air Stosses) and a topical quescL 

Sfm tL f z""".',;'^" °- Information the student should abstract 

il^lT Th^Tf M-'J^^ charaeterlstlcs of fronts and how do they 

form?). These Introductory questions were not present In the original text 
However, to prevent the effects of the questions from being confounded with' the 

^inta if th^'t^^t! '^"'"'""^ '''' approprla^: 

The formats of the organizational aids were varied to correspond to the 
types of relationship being depicted. For Mb, the subject was Identified and 
a numbered llitlng of Its relevant attribute values was constructed 



tor exanpls: 



In the raglpn of the atratoapherai 



1. 
2, 
3. 
4. 



Air tMperatura la very cold. 
The oxygen level is to© low to support life. 
The air temperature la too lo^ to support life. 
There are no elouda. 



f^^^i.^r. 1? ' ^ " arrangraent ^aa used to provide a comprehenelve eom^ 
parlflon of all subjects and atcrlbuteg in m single preeentatlon: A partial 
rsplication of a CR adjunet la presented in Hgure 1 ^- a partial 



Warm Front 



Cold Front 



Formed 
when 

Air 

Pressure 

Storm 
Develops 

Moves 



Warm masi puehee Into 
colder 


.... 

Cold maei overtakeg 
warm mass 


Low 


Low 


Slowly 


Swiftly — 


Slowly 


Rapidly 



Figure 1. Partial repllcatloii of a Comparative 
Relationships adjuact, 
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Finally, for DRs a flowchart was used to depict the order of ivsnts 

in cauie-and-ef f ect relaclonshipa. Where multiple causes or effects were 

involved j a branching system was utilized, A partial replication of a DR 
adjunct is presented in Figure 2» 



Cools in atmosphere 



When moist airi 



I 



1 



Gains more moisture 



then 



then 



Teaperature drops 
toward dew point 




Daw point rises 











I 



Dew point equals air 
temperature 



Cloudss ralris fog form 



Figure 2. Partial replication of a Directed Relationehipi adjunct, 
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Uoderlincd Texts 



The underlined veriions of the text were constructed by simply under- 
llalng all of the text phrases that appemrtd in the adjuaets. A portion of 
the underlined text CQVering the statemanti coatslned in Figure 1 is as followi 

• • * A TO rm front is foraed rtitn a aasa of waTO air puehes 
to to a colder air mass* A cold front is formed i^ai a mss 
of CQld air overtakes a mBBB of imm alr^ There is usually 
as area of low air pressure at a wra or cold front because 
of the rising currents of airV Thm terins warm and cold as 
used here refer to the relative tenperatures of the air naases* 
Tbus^ a cold air mass in suTOer may be many degrees warmer 
than a warn air mass in winter* The aiDvement of the air 
currents at a front depends on the difference in temperature 
of the air masses involved. 

The weather that accompanies warm and cold fronts is as 
follows: Warm fronts usually novt slowly > at speeds of 
from 20 to 30 miles per hour* Storms at Irarm fropta develop 
slowl y^ The first indication of an approaching warm front 
is the appearance of high thto clouds . As the front near a, 
Che clouds get lower and darker / Finally, the sky is black, 

it rains or snows * This whole process My take two or 
three days* By contrast , cold fronts m>vm much wire 
rapidly , ^ , 

Contsat Coverag e 

Ftlot testing Indicated that the entire weather content could not be 
adequately covered within the timm period available. Therefore, coverage was 
reduced to four sections of the chapter and to only CSL and DR relationships/ 
ARs were coasldered the least compleK relationship (mi AR could be considered 
a GR^th only one subject) and, therafore, less likely to nesd diagramatlc 
simplification, for this reason, no avaluatlon of organisational aids based 
on ^s was attempted in the present study* 

Rtlatlonshlps were depicted In the four selected topic sections as 
follows: One section, titled "Evapojatlon and Condensation," was covered by 
a 2 X 1 Ol matr^ and a 10-box DR flow dlagrarai a second section, titled *^easur 
lag HTOldity,'* by a 6-box m flow diagram j a third sectlonp titled "MDvemants 
of Air Masses," by a 2 x 5 CR matrlxj and a fourth, tltlad '^ywther Disturbances 
by a 4 X 5 m matrix. 

Tests 

The subjects' science achievement levels were determined by preinductlon 
scores on the General Science (GS) subtest of the Armed Services Vocational 
Aptitude Battery. TMs subtest, which Includes 20 multiple-choice Items on the 
physical and biological sciences. Is admlnistared to all enlisted military 
rtcrults and is used in conjunction with other subtest scores to screen per- 
sonnel for electronics ratings* GS scores have been validated against final 



performance scorej In Navy Class "A" Schools. For schools with content relat- 
ing to the physical or biologleal sciences U,g., Hospitalman, Electronics 
Tachnlciaaj Fire Control Technician, Coraaunicatigne Technician), cDrrelatlOns 
between GS scores and final school performance Ccorrected for restrlctioni in 
range) were consistently significant, varying from ,42 to .67 and averaging 
about .55. 



Two types of tests were used to compare the instructional effectiveness 
of the experlaeiital treatments i a free-recall test and a 44-itemj aultlple- 
choice test with two choices per item. Two-choice itema were particularly 
appropriate with respect to DRs, since the causal relationships being studied 
typically involved a poisibillty of two results (e^g,, higher/lower /increase/ 
decrease). The two-choice format was adaptable to all of the relationships 
dealt with in this study and was used throughout the multiple-choice test to 
provide a conslscent format. 

Carter (Note 1) argues that free-recall testa should be more aensltive 
to organisation effects since they provide no cues as to hierarchical relation- 
ships* However, the multiple-choice test was deemed to be the more important 
of the two tests used in the present study. The instructional objectives that 
were specified for this study require subjects to integrate related Inforttatlon 
that may be located in various portions of the text. While a free-recall test 
creates no requiremenca for the integration of laforBaatlon, multiple-choice 
questions can be designed to create such requlrOTents, 

Of the 44 multiple-choice itemsj 11 were CR items and 15 were DR items* 
The remaining 18 items dealt with factual information that was included In the 
prose passages but was not relevant to any of the relationships depicted in the 
organizational adjuncti* These were designated as nonrelevant (NR) Itms, The 
CR test itmB required the subject either to associate a subject with its 
appropriate attribute value (Example 1) or to assgciate the correct subjecta 
with a common value (Example 2), 

Example 1. A tornado forms when air pressure rapidly, 

a* rises 
b, drops 

Example 2, Hurricanes and ^ usually originate in the same general 

areas. 



a. tornadoes 

b. waterspouts 

The DR test itemi required the subject to identify either the result of 
a specified causal event or the cause of a specified result (Example 3), 

Example 3, A large difference between wet- and dry-bulb readinga My 
be taken as an indication of ______ relative hmldlty, 

a. high 

b. low 
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Votm chat DR Items asy rsqulre tha gybject to «cogol£e rslationihlps bttwtea 
tvisti that are xidC ItrgRadJlately ralated. Tim abovt Itemp for eicsmplti con-* 
c€irai 4 series of sveacs Im which relative humidity affects the rate of 
evtpoiratloni whlahp in turn, affects the tanparature of a wet^bulb theroooatar 
and, cottsaqueatly, its reading relativa to a dry-'bulb thertoQaater. If the 
dubjact has aatiafiad the Initruetional objective and formed an understand^g 
of £hs proaeas by whieh evtata In the OR ocourp then he should ba able to 
r%c©astruet the proceaa sad form a correat asaoclatlon betwen any tw steps 
iXL ehs aerles» 

The NR items requtrsd the subject to recognize the missing portloa of 
a verbatto or paraphrasad replication of a statement presanted in the text 
(fiwmjpla 4) » but not in che organiiatloaal adjuncts. 

Itompla 4. Hurrlcamta occur in sunmer. 



a, early 
bp late 

Hots that m items are diatljigulshabia from CR and DR items only in terms of 
the iastructlonal ©bjeetlveai thRt ISp for items subjects were not required 
to recognise relationships between attributes or ordared evants* Tha NR Itemg 
%mtm ufleid to deteraine whathar advantages obtained with respect to the reteatlon 
of coaceptually related facts would ba obtained at the eKpense of tha more In* 
depandiat statements, Sothkopf and Bisblcos (1967) reported such shifts in 
parformnca from one type of information to anothar as a result of insarting 
diffarest types of questions liito text. 

All multiple^cholce ItetBs were individually reviewed for clarity and 
adequacy of content covaraga by two research paychologists and four graduate 
asslstaatSt Any items that were difficult to understand or to relate to the 
text vara either deleted or revised, Mthough some topic areas were found to 
pravlda imtm test items than otharsp there was general agreement that the test 
It^ias ptovidad an adequate eoveraga of tha four topic sections. 

The free-racall test was developed to determine whether or not dif-- 
ferinces In the ability to identify correct stataments of f elationships would 
correspond to dlfferencas In the ability to recall factual information con- 
cerning those relationahlps« As Frase (1969) demonstratad with respect to an 
uwdarstandlag of chess moves p significant ImprovMeats In free recall do not 
necas8ardU.y result in improved capabilitlas to apply that information* On tha 
othar band| it would ba eKpicted that improvemehts in the ability to answer 
questions about a given subject could result from ioprovamants la the recall 
of lofarmation relevant to that subjact. The free--recall test was Included 
in the present study to assess this latter possibility. 

Only one CR and one DR were covered by the free^reeall test* Thia re- 
striction was necessary because of the limited ttoe available for tasting, 
Fraa^recall teat sheets conslstad of blank pieces of paperi each with the same 
topic question that appeared on the corresponding organisational adjunct and 
tmnt section. For the CR free-recall test sheet i the question wass What aiml- 
laritiss and dlfferencas are there in the formation of tornadoes^ watarspoutSi 
hararlcanes^ and thunderstorms? For tha DE recall test sheet » tha question wasi 
VftAt is the process by which vara, moist air Is condensed into clouds, fogp rain, 
and dav^ 
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4 4 . f Vocabulary portion of the Neason-Dflnny Raading Test was 

administered between Che tnd of the study period and the beginning If testing. 
ThlBi^as done to interrupt attenpts to maintain InloWBtlon In short-tenn" " 
oemory by rehearsal, 

. . finally, a t*lef questionnaire (see Appendix) was developed that directed 
subjects to indicate how adequately they were able (1) to cover the content with- 
adjujit*! ^ '° "'^^-'"^nd uclll.e the organisational 

Frocedure 

Assignment to Treatnencs 

^ The subjects were from four eorapanles of 53 to 84 recruits. All sub- 

jects were dealgnated as "Highi" (General Science scores above 55) or "Lora" 
(General Science scorea at or below 55). Previous testlni had Indicated that 
this caCigorlEation would result In approximately equal numbers of Highs and 
Lows. To ensure that their learning skills would bt adequate to deal with the 
training content, those (about 5X) with scores below 40 were eliminated from 
tha 6Kparlment* 

Treatments were assigned separately for Highs and Lows. Asslgnoents 

u^pti'fr^"Sf J rfw"^ ^""^^ companies, by alphabetical order 

until 28 subjects had been designated for each experimental cell. The sub- 
jects in the first three companies were assigned at random to instructional 
treatments, and the fourth company received no instruction. All four companies 
were administered the Bultiple-choice test In the same manner. wnpanies 

Adttlntstratlon of Treatments 

™ ^ subjects were Informed that the purpose of the study was to evaluate 

methods for presenting Instruction and that findings fron, this effort would be 
applied to make Navy course work easier and more interesting Previous In- 
o^^M^ff aled that Navy enlisted personnel respond favorably toward 

participation In efforts to improve Navy course work. In accordance with Naw 
brvolfntafj subjects were also informed that their participation would 

The subjects who received Inatruction were given 16 minutes to study 
the four prose passages. It was suggested that they spend 4 minutes studying 
each passage, and they were cued as each 4-mlnute time period elapsed. Follow- 
ill ^ f subjects were provided an 8-minute review period. For 

Treatment TiubJects were Instructed to review the passages chat they had 
already studied; for Treatment T-U, copies of the text with related statements 
underlined; and for treatment T-A, sets of diagrams that su,Bnarl.ed statement 
relatlonahtps. It was suggested that they spend 2 minutes with each topic 
and they were cued as each 2-mlnute time period elapsed. Followin« the 8- 
mlnute review, subjects were given a final 5 minutes to study and review any of 
the materials that they had received, ^ 
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Fdliuwit)g ihiCieuGtldndi pe^loclii rtubjeebi were ddttinlititid the 
voaabulary teat for 10 minuted* Thin they were admin la tar ad the multiple-^ 
choice test for 25 minuted^ follawed by the ^ree«redall test for 16 mlnuteg 
and| flnallyi by the Dplnlon questionnaire. 

Scoring of Teflts and Quest lionnalres 

Scores far the multiple-choice test wera represented by the numbor of 
test itms answered correctly. Scores were tdbulAted for the entire test and 
for separate portions of the test covering CRp M| and NR Itmsi 

In scoring free-reaall performanoe for the CR questions p one poinc was 
given for each correct association made between a subject and an attribute 
value* In addltioni points were given for each subject that was correctly 
related to another subject with respect to any given attribute (e.gii water- 
spouts and tornadoes are both caused by a sudden change In temperature) * In 
the above statement two subjects are being related with respect to a single 
attribute^ so two points would be scored. Two specific statementSi each cor-* 
rectly associating a given subject with the same attribute i would receive a 
score of four points^ one for each specific association and two for the relation*^ 
ship jjiplied between the two subjects* The highest possible score for the CR 
portion of the free-recall test was 16 pointsi 

Far the DR portion of the free-recall test^ scores were based on the 
number of correct cause^nd^eff ect relationships that could be generated from 
the recalled content. For eKamplep if the subject recalled that event a causes 
h and event b^ causes c^^ then three such relationships are implied (ab| ac, and 
be) I so a score of three points would be given. Recalled relationships were 
given credit even if some intermediate steps were missed. Supposei for example » 
the relationship wasi "Event ^ causes b^i b^ causes £| £ causes d| and d causes 
e^." if the subject forgot b^ and only rra^bared that £ causes £ causes d» 
and d causes e^^ he would still receive 6 points for the six possible relation- 
ships implied by his recall (aCt ad| aet cd| cSi and de) , The highest possible 
score for the DR portion of the free-recall test was 20 points* 

Questionnnaire responses with respect to the adjunctive diagrams were 
givm numerical values. For usefulness i a response of "Very Useful" was as- 
signed a value of 3; "Useful i" a value of 2; and '*Not Useful i" m value of 1. 
Similarly^ for understanding , a responsa of "Very Easy" ms asslgQad a value 
of 3; "Easy," a value of 2| and "Difficulty" a value of 1. Quest lonnalre 
responses with respect to topic coverage were scored in terns of the number 
of topics covered « 
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RESULTS 



To iMlntaln gtoupa of equal size, only 28 ot the aubjecta assigned to 
aach group ware Included In the data analyBis. This pMVlded eight groupg 
o! 28 BUbj«ctB, lour groupi with relatively low and four with ralativaly 
high l«v«la of geneifai ■clenca achievaafint. Mean Generttl SelBnce (OS) flcorea 
for the •ight groupa art preaented in Table 1. A sunnary for a 2 x 4 analyslfl 
of varlancB (ANOVA) performed on theie OS scores ig preaented in Table 2. 
Thla analysia revealB the expected significant dlffarencea between high and 
low OS groupings but no ■ignificant main tffecta or interactions involving 
treatnant asiignaencf. 



Table 1 



Mean GS Scores for All Subject Orouplngs 



. . Instructional Treatmenta 

AchlevttQfint Test - . _ _ _ _ , 

Croupa N Only T t-U t-A 

"i-ih 28 60.8 61.7 61.9 62.0 

Lov 28 47.4 4R.9 48.9 50.3 



Table 2 

ANOVA Summary for OS Scores of Teat and Treatment Groups 



Source 


df 


ns 


f 


Treatteats (A) 


3 


26.0 


.7 


OS Levels (B) 


1 


9218.6 


244.7* 


A X B 


3 


58.5 


1.5 


Residual 


216 


37.7 





*p < .001, 



28 



Toyt Vaiiaity 

The voildity of this tiiat waa determined by cotnpuring teat Beoreg 
agttinat u previously establiahid measure of achievement on sciance-related 
cgntenti namely I th^ OS scoriSi A Pearson Product-Moment Correlation for 
168 aubjecfca who received the instructional treatments indioated a statistically 
significant poaitlva relationahlp (r * ,49| p < .001). 

Instructional Ef f activeneafl of Tmt 

The major hypothtsis of the prasent study was that the af f ectlveness 
of typical taxtual initruction can be enhanced by organizational aids. This 
hypothesis assumes that the course work is already reasonably effective. 
To assess the af f ectlveneas of the course worki overall scores were com- 
pared for groups receiving treatment T and groups receiving no Instruction, 
Mean multlple^cholce test performanee scores for these tm groups (along 
with those of the rest of the groups) are displayed in Table 3, A summary 
for a 2 X 2 AKOVA performed on these scores is presented in Table 4 



Table 3 

Mean Number of Correct Items on the Multiple^choice Teat 



Item 
Types 


GS 
Level 




Conditions of 


Instruction 




None* 


T 


T-U 


T-A 


All 


High 


25.6 


31.8 


33.8 


33.5 




Low 


24.5 


27,4 


26.7 


28.6 


CR 


High 




8.8 


9.9 


9.6 




Low 




7.0 


7.6 


8.0 


DR 


High 




9.5 


9.5 


9.9 




Low 




8.2 


8.2 


8.8 


NR 


High 




13.6 


14.4 


14.1 




Low 




12.2 


11.0 


11.8 



Note t Each mean is based on the scores of 28 subjects. 



Only overall scores covering all types of iteme are used in comparing groups 
receiving no Instruction against treatment groups * 
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Table 4 

AHOVA Sumiaify for Overall Multiple-choice feet 
Scoria for CtQUps Vho Did and Did Not Receive Instructional TeKts 



Source 




ms 


f 


Treatments (A) 


1 


695.0 


36.5* 


OS Levels <B) 


1 


237.2 


12.5* 


A X fi 


I 


55.7 


2.9 


Residual 


108 


19.0 





*p < ,001 



Tha raaults indicated statistically significant main effecta both for 
treatmants and for GS levels. Subjects who received the Instruational text 
scored signiflesntly higher on the multiple-choice test than thoae who did not 
and those with high GS achievement scored higher than those with low GS achlev 
ment. The interaction between treatmenta and GS levels was not algnlflcant« 

Comi^rison of Treatments 

Separate 2x3 ANOVAs were conducted for overall test performance and 
for performnce on each type of multiple-choice teat item* Each of these 
analyses compared groups of subjects with high and low GS scores that re-- 
celved instructional condition T, T-Up or T-A, Mean multiples-choice test 
scores for each group are presented in Table 3, A sumroary for the four 
analyses is presented in Table 5, Results of the analysis of overall 
performance scores indicated a large significant main effect for GS levels 
but no effect for treatments and no interactions, 

A significant main effect for GS levels was found for CR, DR, and NR 
items, ^In effects for instructional treatments were only found for CR 
items and there were no significant interactions* Howeverp an inspection 
of Table 3 reveals that means were consistently higher for the r--A than for 
the T treatment except for NR items , which did not test for knowledge of 
content relationships. 

From an examination of mean CR scores in Table 3^ it appears that 
treatment effects could be attributed to differences betwen T--A and T. 
This possibility was verified by applying a Dunnett post*hoc test* In 
applying the Dunnett test the typical procedure of compartag several treat- 
ments against a control was reversed since, in this case, two controls 
(the T and Che T-*U treatments) were being compared against a potentially 
superior condition (the T-A treatment)* Application of the Dimnett test 
revealed that mean ffi performnce scores for the T--A treatment were sig-^ 
nlfldantly higher than those for the T treatment (d * 2,31, p < ^05) but 
not higher than those for the T-U traatment. 
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Table 5 



ANOVA Summary for Mulciple-chQlce Teat Seorea 
for TreatmeiU Groups Receiving Inatructlon 



Item 
Types 


Source 


df 


ms 


f 


Ail 


Treatments (A) 


2 


33.0 


1.4 




GS Levels (B) 


1 


1237.7 


53.4** 




A K B 


0 


d,^ m D 


1. 3 




Residual 


162 






CR 


Treatments (A) 


2 


18.4 


4.0* 




GS Levels (B) 


1 


139.3 


30.1** 




A X B 


2 


2.3 


.5 




Residual 


162 


4.6 




DR 


Treatments (A) 


2 


3.6 


.7 




OS Levels (B) 


1 


56.0 


11.5** 




A X B 


2 


.4 


1.0 




Residual 


162 


4.9 




NR 


Treatments (A) 


2 


1.1 


.2 




OS Levels (B) 


1 


233.4 


41.7** 




A K B 


2 


14.6 


2.6 




Residual 


162 


5.6 





*p < ,05 
**p < ,001 



Free-recall Test Perfomance 

Because of the limited time available for testing, only two of the four 
topic areas covered by the multiple-choice teat were testad for free recall. 
One of these topics contained a DR; and the other ^ a CR, 

Interrater Reliabilities 

Before the final grading of recall responses, a sample of 30 recall 
sheets (5 selected from each of the 6 treatment groups through random 
numbers) was graded separately by 3 individuals to determine Interrater 
reliabilities. For the CR topic the average interrater reliability was 
,90; for the DR topic, ,83, This level was sufficient to allow for separate 
grading of the remining responses. Graders blind-scored each recall sheet 
irtthout information concerning GS or group membership* 

Comparison of TreatTOnta 

Separate ^analyses were performed for overall free-recall scores and 
for CR and DR portions of the free-recall test. Mean free-recall scores 
for each treatment group are displayed in Table 6, and a sumary for the chree 
analyses is presented in Table 7. 
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Table 6 
Mean Frtie-recall Scores 



Test 
Poreloas 


GS 

Level 


Conditions 

T 


of Inatructlon 
T-U 


T-A 


OR and DR 


High 


13.3 


16.3 


18.0 




Low 


8.0 


7.2 


9.4 


CR 


High 


9.3 


11.6 


11.0 




Low 


5,9 


5.4 


6,7 


DR 


High 


4.0 


4.7 


7.0 




Low 


2.1 


1,8 


2.7 



Note. Eaoh msan is baied on the icores o£ 28 subjecta* 



Table 7 

ANOVA Swmaary for Free-recall Scores for Treatmmt Groups 



Test 

Portlona SQurce df mm f 



CR and DR Treaooiaats (A) 


2 


117.6 


2.2 


GS Levels (B) 


1 


2445.7 


44.7** 


A X B 


2 


67.2 


.2 


Residual 


162 


54.7 




CR TreaCmeQCs (A) 


2 


26.0 


.8 


GS Levels (B) 


1 


924.0 


29.8** 


A X B 


2 


29.2 


.9 


Residual 


162 


31.0 




OR Trea^eots (A) 


2 


39.0 


3,2* 


OS Levels (B) 


1 


323.1 


27.0** 


A X B 


2 


25.2 


2.1 


Residual 


162 


12.0 





*p < .05 
**p < .001 
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In tmmB of overall recall pGrformance there was a signif leant main 
effect for GS levels. However, there was no main effect for treatments 
and no Interactions. 

Main effects for GS level were also significant for both CR and DR 
portiona of the recall test. The only other significant difference involved 
a main effect for treatraents for the DR portion of the recall test, How- 
ever, an Inapaction of Table 6 reveals that means were consistently higher 
for T-A then for T treatments. 

Application of a Dunnett post-hoc test to the DR recall data (in the 
same manner as was described for the analysis of the CR multiple-choice 
test) indicated that mean recall scores for the T-A treatment were signi- 
ficantly higher than for either the T treatment (d « 2,4^ p < .05) or the 
T*U treatment (d *» 2.0, p < .05), 

Recall Versus Recognition 

A relevant consideration is the degree of correspondence between the 
ability to recall and reconstruct content relationships, and the ability 
to select a correct response relative to those relationships , The results 
of a Pearson Product-Moment Correlation Indicated a strong and statistically 
significant relationship between free-recall scores and mult Iple-cho ice 
test scores for the 168 subjects who received the instructional treatments 
(r » ,69, p < .001). 

Questionnaire Responses 

Only the T-A group received organisational adjuncts. A comparison of 
the responses of T-A subjects with high and low GS scores was conducted to 
assess the uaafulness of the adjunctive diagrams in helping them to organise, 
understand, and remOTber the text content. The subjects were asked to give 
a rating of "Very Useful," "Somewhat Useful, or "Not Useful," For helping 
them to organize and understand the content , a rating of "Very Useful" was 
given by 42 percent of the Highs and 39 percent of the Lows. A rating of 
"Somewhat Useful" was given by 57 percent of the Highs and 54 percent of the 
Lows. For facilitating retention, a rating of "Very Useful" was given by 
42 percent of the Highs and 36 percent of the Lows, A rating of "Somewhat 
Useful" was given by 46 percent of the Highs and 42 percent of the Lows, 

On a scale of 1 to 3 (where "Not Useful" was given a value of 1 and 
"Very Useful" a value of 3), mean ratings were compared for Highs and Lows. 
The results of this comparison indicated no difference between Highs and Lows 
for usefulness of the organizational aids in assisting them to organise and 
understand the content (t ^ .39, p > .05), or for helping them to retain 
the content (t ^ .00, p > ,05). It appears that most of the subjects did 
find the aids useful and that Highs found them Just as useful as did Lows* 

For ease of understanding, subjects were instructed to rate the adjunc- 
tive dlagrama as "Very Easy," "Relatively Easy," or "Difficult." Few subjects 
appeared to consider the diagrams "Difficult"; a racing of "Very Easy" was 
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given by 60 percent of the Highs and 32 pereenC of the Lowa. A rating 
of "Relatively Easy-* was given by 36 percent of the Highs and SO percent 
of the LowSt On a scale of 1 to 3 (where '■Dlffleult" was given a value 
of 1 and "Very Easy" a value of 3), a comparison of mean ratingi indicated 
algnif Icantly higher ratings by the Highs (t ^ 2,3, p < ,05), who apparently 
found the diagraffis even easier to understand than did the Lows* 

It had been hoped that the study periode would be sufficiently long 
to allow moat aubjects to study each topic area thoroughly. However , many 
aubjeeta Indicatad that they did not have aufficlent tiae to eomplete all 
of the topics. For Highs the mean number of topics covered was 2*96 for 
treatmait T, 3,50 for T-U, and 2,96 for T-A. For Lows the mean number was 
2.25 for treatmtnt 2*59 for T-U, and 2,73 for T-A* The aummary for a 
2x3 ANOVA for these scores Is presented In Table 8* The results indtoate 
a main effect for OS level but no effect for treatments and no interactions* 
Therefora, although topic coverage was incompletei it was consistent across 
treatmmt groups* 



Table 8 



ANOVA Sunmary for Levels of 


Course 


Completion for Treatment 


Groups 


Source 


df 


ms 


f 


TreaCments (A) 


2 


2.7 


1.8 


GS Levels (B) 


1 


12.6 


8.3* 


A 3C fi 


2 


3.4 


2.2 


Residual 


162 


1.5 





*P < .01. 
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CONCLUSIONS 



The primary purpose of this study mm to eviluflte an approach for 
iaprovlng laarning by clarifying conciptuai relationshlpi contained In 
instruetional teKts^ Tha approach iavolvad an analysis of contant to 
Identify spaclfied types of relationships and the graphic depiction of 
thaat ralationships for usa as adjunctive organisational aids* 

The results of thla study Indicate that organisational aide can facili- 
tate the learning of content relationghips. Frae-reeall perforroance on 
a series of cauie-and-ef feet relationships (DRs) and multiple-choice tast 
performance on matrix-type relationships (GRs) were signifleantly enhanced, 
Evan where aignif leant gains w^ere not achieved, mean seorea were consis- 
tently higher for groups that received organisational aids t^lth the text 
than for groups that received the text alone* 

A aecondary question warn whether the effecta of organisational aids 
could be attrlbutad to their emphails on certain Itams of Information rather 
than to thtir organizational effects per ae. Groups receiving the aids were 
compared with groups receiving text with the critical Items underlined. For 
free-recall performance on cause-and-aff act relationships (DRs), grQupa 
receiving the organizational aids were superior. However, for multiple- 
choice test performance on matrlK-typa reiationahlps (CRa) ^ organiaattonal 
aids and underlined text pasaages were equally effective* These findlnga 
indicate that some part of tha advantages galnad from using organlgational 
aids can be attributed to the emphasis that thay place on certain portions 
of the content. 



It has been hypothesised that the effects of the organizational adjuncta 
should be stronger for iubjacts with lowar levels of previous learning 
achievement in similar contant areas. Contrary to this eKpactationi no 
significant interaction batwesn treatment and previous achievement level 
was indicated^ although subjects with higher achievement levels conalat- 
tently performed better on tests administered in the present study. Thus, 
it appears that organisational aids affect the performance of all perionnelj 
not just those who experience learning dlf f Iculties* ' 

There appeared to be a general eorraspondence between the recall of 
content relationships and the ability to answer questions about those rela- 
tionships* The correlation between performance of frea-recall and multiple- 
choice teats was significant* Such a relationship appears reaaonablel 
student would not be expacted to apply content that he could not recall. 

For damonstrating the importance of organization for learning content 
relationships, the present findings are weak and inconsistent. The only 
condition where gains from organlmtlonal aids could be attributed to the 
effects of organization was the free recall of causa-and-effect relation- 
ships (DRs), Gains in miltlple-cholce performance on MLtriK-type reiation- 
ahlps (CHs) could not be attributed to the organizational effects of the 
aids, since underlining statements within the text resulted in equally 
high performance levels. The fact that free recall was more sensitive to 
the effects of organisation than performance on multiple-choice items is 
consistent with previous findings (Frase, 1969| Carter & Carrier, 1974) . 
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To the extent that underlining relevant statements warn as effective 
as organizing those sfcatenientB into matrix diagrams^ it might be hypothe- 
slged that the gains produced by the T*A and T-U treatinents were simply a 
function of selective attention to the relevant contenti Howeveri selee- 
tive attention to eBiphaslEed content might be eKpected to result In a deteri- 
oration of performanci on other nonrelated content . No such deterlorlation 
dld^ in factj occur, A different ixplanation of the gains produced by under- 
lining may be suggeatsd that Is more congruent with the position of Carter 
and Carrlsr (1974), who suggest that students have a robust ability to 
organize content subjictlvely. Identifying the critical points of informa- 
tion may have facilitated such subjective organisation and subsequently 
allowed subjects to recognize relevant relationships by themselves. 

The weak and Inconsistent effects achieved In the present study parallel 
results from earlier efforts to establish superior performance advantages 
for one method of organization over another (Prase, 1969, 1973 ■ SchultE & 
DiVesta, 1972; Hyeri it al., 1973; Friedman it Greltzer, 1972), Therefore, 
this study has substantiated earlier findings but with respect to more 
compleM types of content relationships* 

The continuing failure of efforts to dettonstrate consistent advantages 
for particular organisational strategies raises, once again, the question 
of whether or not it is practleal to systematise Instructional organlza-^ 
tlon. It may be that the beneflta of specific content arrangements are so 
dependent upon the context of the instruction and the orientation of the 
individual student that no one method of depicting relationships Is consis- 
tently superior. However, the potential advantages of adjunctive graphic 
displays cannot be coispletly dismissed. An Important consideration that 
deserves additional attention la how the student perceives the Instructional 
content* M though the content used in the present study vas less artificial 
and closer to typical classroom instruction than that used In previous studlei 
the Inatructlonal situation was still presented to the subject In an eKperi- 
mental context* Subjacts knew that their study times were to be brief and 
that the only application for the Informatidn would be on a subsequent 
test. Under such conditions their motivation mmy have been insufficient 
to produce differences in treatment group performance. 

With an Instructional content that Is more useful to the student in 
terms of future needs, perfoftmnce differences between treatment groups 
should increase, Stoce performance means on related content were consis- 
tently higher for subjects receiving texts supplemented with graphic dis- 
plays than for subjects receiving teKts alone, consistently significant 
advantages for the graphic aids might well result. 

The effects of organisational aids may also be stronger where longer 
study and retention times are involved. In clarifying relatlonehlps, 
organliatlonal aids provide a structure to help subjects to retain content. 
If the study periods are too short for the subjects to learn the relation-^' 
ships, however, and if the retention periods are mt so long as to make It 
difficult for subjects to remember the content, then the benefits of organ- 
izational aids will be minimised. Two major orientations are suggested for 
future research into applications of organiMtional aids. First, the 
research should deal with instructional content that is relevant to the 
needs of the student. Second, the research design should allow for varying 



the amount of time between the presentation of Inatructlonal content, the 
testing of recall, and the application of that content. 

If organizational aMa are ahown to be effective under realistic con- 
ditions of Initruction, they would provide a considerable advantage to the 
Navy's current effort to revlie its course work development procedurea. 
Over the next 12 years this effort will affect every major area of class- 
room instruction now being conducted by the Navy. 

One of the key eliments In the Navy's approachp as outlined In the 
Inter**8ervlce Procedurea for Instructional Systems Development (1975), is 
the establishment of criterion levels of performance that the training 
materials must satisfy. If resulting course work is inadequate, than it 
must be revised ijmtil criterion levels are met* Systematic, rather than 
trial-and-error , techniques for organising instruction must be used if 
requirements for such revisions are to be minimised with subsequent savings 
of time and money. 
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APPENDIX 
OPINION QUESTIOmmiRE 



OPINION QUESTIONMIRE 

Please circle your response to the following questions i 

1, The set of study materials you received covered four separate topics. 
How many of these were you able to study thoroughly in the study 
period? 

0 12 3 4 

If you did not receive ai^ review diagrams as part of your instruction go 

to Question 5* If you did receive review diagrfflnSj answer QuestioQS 2--4 before 

going on to Question 5. 



2. How useful were the review diagrams in helping you to organize and under- 
stand the Information you atudled? 

Very Useful * Somewhat Useful Not Useful 

3« How tisef ul were the review diagrams In helping you to remember the 
information you studied? 

Very Useful Somewhat Useful Not Useful 

4. How easy were the diagrams to understand? 

Very Easy Relatively Easy Difficult 

5. Do you have any suggestions for improving the ef fectivenesa of the 
materials? 
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